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Abstract 

This paper studies a network of observers for a distributed estimation problem, where each observer assesses a 
portion of output of a given LTI system. The goal of each observer is to compute a state estimate that asymptotically 
converges to the state of the LTI system. We consider there is a sparsity constraint that restricts interconnections 
between observers. 

We provide a sufficient condition for the existence of parameters for the observers which achieve the convergence 
of the state estimates to the state of the LTI system. In particular, this condition can be written in terms of the 
eigenvalues of the Laplacian matrix of the underlying communication graph and the spectral radius of the dynamic 
matrix of the LTI system. 



I. INTRODUCTION 

In this paper, we discuss a distributed estimation problem for a system observed by a network of m LTI observers 
Consider a LTI system is given as follows with the output vector y(fc|^ 

x{k + 1) = Ax(k) 

(1) 

yik) = Cx{k) 
where 

y{k) = {yl{k), • • • , yl{k)f , C = (Cf , • • • , Clf 

x{k) e M",y,(fc) e M''* 

Each measurement yi{k) is assessed by observer i, and interconnected observers form a network of observers. 
Each observer is allowed to share its local measurement and state estimate with nearby observers (neighbors) via 
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'without loss of generality, we assume that m > 2. 

^In the presence of bounded noise, our result gives bounded estimation error. Since the way this can be proven is same as one presented in 
this paper, we omit noise terms in state space representations due to the space constraint. 



communication links, which is subject to communication constraint^ The communication constraints introduce a 
sparsity pattern in the formulation of our distributed estimation problem. Henceforth, we refer to this constraint as 
a sparsity constraint. 

Our main goal is to design a network of observers which cooperatively computes the state of the system described 
by Q. In other words, let Xi{k) be the state estimate by observer i then our goal is to have limfe_s.oo — 
for all i e {1, • • • ,m}. The main challenge in this distributed estimation problem comes from the Umitations 
that no single observer can compute the state of the system only with its local measurement, and the exchange of 
information is restricted by a sparsity constraint. Thus, the classical system theory cannot be directly applied to 
finding such observers. 

Similar distributed estimation problem for (dynamical) linear systems has been studied with various approaches. 
For example, in [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], the design of a linear observer is discussed. In 
particular, in [6], [7], [8], [9], [10], different types of consensus-based Kalman filtering are proposed, while a 
nonlinear approach (moving horizon estimation algorithm) [11] is utilized in a distributed estimation problem. 

Among the previous works. Khan et. al. [1] proposed a consensus-step estimator for distributed state estimation, 
and other notions to provide sufficient conditions for the stability of the proposed estimator Their work focused on 
finding design parameters - consensus gain and observer gain - for the estimator, depending on a quantity called 
"network tracking capacity". The design procedure is simpler than ordinary observer design procedures due to the 
simplification in computing parameters, and distributed computation of the parameters is possible. However, from 
a system theoretic point of view, the proposed method works under assumptions that are stronger than ours. 

Also Matei and Baras [2] proposed a consensus-based linear distributed estimation algorithm. Unlike the work 
by Khan et. al. [1], the authors assume that a consensus gain is given, and they concentrate on finding sub-optimal 
observer parameters in a closed form. Also sufficient conditions for the stability of the observer are presented. Since 
the choice of the consensus gain reflects the characteristics of an underlying communication graph, this work does 
not consider the effect of the underlying graph on their distributed estimation problem. 

In this paper, we consider, given a sparsity constraint, the design of a network of augmented observers for the 
distributed estimation problem. A key contribution of this work is to provide a sufficient condition for the existence 
of augmented observers, where the state estimate by each observer asymptotically converges to the state of the LTl 
system. First we investigate under what condition the underlying communication graph is capable of estimating 
the state of the LTl system in terms of eigenvalues of the underlying graph and the spectral radius of the dynamic 
matrix of the LTl system. Under this condition, we prove the existence of a network of augmented observers that 
fulfills our objective. 

The following notation is adopted: 

'Here we assume that the communication links are bidirectional and time-invariant. The topology of a network of observers can be represented 
by a graph, whose vertex set is a set of observers and edge set is a set of communication links. Henceforth, we refer to this graph as a 
communication graph. 



Let observer i and observer j be neighbors if there exists a communication link between the two observers. 
Then a communication graph, subject to a sparsity constraint, can be described by the Laplacian matrix: 

and i & j are neighbors 



(2) 

otherwise 



where [L]ij is i,j-th element of a matrix L. Notice that L is a m x m symmetric matrix; hence it has m 
real eigenvalues. An eigenvalue of L and its corresponding eigenvector are denoted by and Vi, respectively. 
Without loss of generality, we assume that Ai < A2 < • • • < A,„. 
. (Pattern Operator) [12] 7'(L) e {0, 1}™^™ to be the binary matrix 

rfef I if the block \L]i, = 

mm, = ' (3) 

I 1 otherwise 

We define < ^(^2) if [V{Li)]^j < [V{L2)]^j for all j G {1, • • • , m}. 

• /„ is a n X n identity matrix, is i-th column of /,„, and 1 is a vector with each element taking value one. 

def 

• The set of all unstable eigenvalues of V is denoted as Ai/{V) ~ {A : |A| > 1, det{V — A/„) = 0}. 

• For an eigenvalue. A, of a matrix V, the algebraic and geometric multiplicities are denoted by ay (A) and 
(7v(A), respectively. For notational convenience, we sometimes denote an eigenvector, v, of V corresponding 
to A e sp{V) as w e Null{V - XI). 

The paper is organized as follows. In SectionlH] we describe the structure of an augmented observer and associated 



error dynamics. In Section III which presents the main result of our work, we focus on proving the existence of 
a network of observers, where the state estimate of each observer asymptotically converges to the state of the LTI 
system. Finally, discussions and future directions are presented. 

II. Problem Formulation 

In this section, we introduce the structure of our augmented observer used throughout this paper First, we recall 
that given parameters to the design of a network of observers are A, {Ci}ig{i ... ,„}, and {A/i},;g{i,... where 
Mi is a set of neighbors of observer i including observer i itself. 

This observer is called augmented because the dimension of its state is larger than that of the LTI system. Thus 
the dimension of the augmented observer is no smaller than that of the corresponding Luenberger observer. As it 
is explained in the following section, with the augmented observers we are able to adopt the schemes used in the 
design of a dynamic compensator for LTI systems [13], [14]. Considering this point, we present the augmented 
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Fig. 1. A framework for distributed estimation 



observer as follows. 



J, J A ij(fc) +H,j (yj(fc) - C'jfj-(fc)) 

State estimate measurement residual 



(4) 



augmented state 

z,(fc + 1) = 51 + - Q2;,(fc))] 

where e S^^ e M"><^j, Q^^ e E^'^^'^^, and e Ra-.x^,^ ^nd is the dimension of the augmented 

state Zi. We refer W to a weight matrix, where «,j-th element of W is defined as [WJ^j = Wjj, and H^, S^j, 
Qij, and to gain parameters. In this work, we focus on finding the weight matrix and gain parameters such 
that ||a;j(fc) — a;(A:)|| as fc — !• oo for all i G {1, • • • , m}. 

that achieve our objective while satisfying a given sparsity constraint. 

Suppose, for each i E {1, ■ ■ ■ , m}, J2jeJ\f- ^ ^' ^^^^ error dynamics of Q can be written as 

e,{k + 1) - XI " H,jCj-) Cjik) - S,jZj(fc)] 

(5) 

Zi{k + 1) = X! + QijQ<^i(^)] 

def 

where ei(fc) = a;(/c) — Xi(k). Throughout this paper, we assume that Wy = Wj-; for all i,i e {1, • • • , m}. 

Remark 2.1: Notice that the error dynamics (|5]l is similar to the state space representation treated in the de- 
centralized control problem [13], [14]. Hence, once the weight matrix is found and the existence condition for a 
network of observers is satisfied then the gain parameters can be computed by the result in [13], [14]. 

In this work, we are interested in the design of augmented observers under the choice of W = /„i — aL, where 
a > and L is the Laplacian matrix of an underlying communication graph. It is beneficial to derive W from L 
since W inherits the spectral property, i.e. eigenvalues and eigenvectors, of L 

'^One may have a better choice of W which, for instance, gives smaller eigenvalues by solving an optimization problem [15]. 



Notice that we may collectively rewrite (|5]l as follows. 

^z{k + l)j y QC k) \z{k) 

where C (ci ® C-[ , ■ ■ ■ , e™ (8) C^"^ . Let L be the Laplacian matrix, which describes the underlying commu- 
nication graph, then (|6]l satisfies a given sparsity constraint, i.e. 

P(H) < V{L),V{S) < V{L),V{Q) < V{L),P{Il) < V{L) 
III. Main Result 

The main theorem of this paper is presented in this section. First, we provide the main theorem without proof, 
then we state and explain supporting propositions and lemmas followed by the proof of the theorem. To state the 
theorem, we recall the following notation: let L be the Laplacian matrix of a communication graph, and A2 and 
Am be the second smallest and the largest eigenvalues of L, respectively. 

Theorem 3.1 (Main Result): Suppose a detectable LTI system described by {A^C) is given and it holds that 

p{A) < 

^m — ^2 

where p{A) is the spectral radius of A. For the weight matrix W, choose 

W = /m - aL 



where a satisfies 



A^i(l-p-i(A)) <a< A„i {l + p-'{A)) 



Then, for each i,j E {1, • • • , m} and for some fij e 2+, there exist the gain parameters H^j £ M"^ ''^ , Sij E M"^^j , 
Qij E M^'^''j , and R,y E M^'^^j that satisfy a given sparsity constraint, i.e. 

V{H) < V{L),V{S) < V{L),V{Q) < V{L),V{Ii) < V{L) 

and stabilize the error dynamics (|6]|. 

Remark 3.2: As is stated and proved later, the choice of a e (A2^^ (l — p^^{A)) , A^^ (l + p^^{A))) is allowed 
if and only if p{A) < ^"^^^ . This result only gives a sufficient condition; hence even if p{A) < does not 

hold, there may exists a network of observers. 

A. Preliminary Results and Properties, subject to W = Im ~ otL 

Our choice of W = /m — aL is adopted from the consensus literature (for instance, see [16]). It is beneficial 
to use this relation since the existence condition can be represented by the Laplacian matrix of the underlying 
communication graph. The following proposition supports this argument. 

Proposition 3.3: Suppose the Laplacian matrix L is irreducible. Choose W = — ctL, where a > 0. If the 
spectral radius of A, p{A), satisfies 

piA) < 

Am — -^2 



then for 

ae (A2-i(l-p-i(A)),A„i {l + p-\A))) 

it holds that each eigenvalue of W (E) A is either in Aij{A) or inside the unit circle. Furthermore, the algebraic 
multiplicity of A e A(7(W (g) A) is equal to a^(A). 
Proof: Since L is irreducible, 

= Ai < A2 < • • • < A™ 
Set W = /,„ — aL, then the eigenvalues of W satisfy 

1 = 1 — aXi > 1 — > • • • > 1 — ctXm 
To achieve our goal, we want to have 

1 > p{A){l ~ aAz) > • • • > p{A){l - aX^) > -1 

This gives us an inequality: 

A^i (1 - p-\A)) <a< A,-i (1 + p-\A)) (7) 

A,„ + A2 



We can see that such a exists if p{A) < ^ 
Notice that [17] 

iw^aW = ^ aw(Aw)ayi(AA) 

For A e A[/(W (g) A), if (|7| holds then it is true that A = AwAa with Aw G sp(W) and A^ e sp{A) if and only 
if Aw = 1- Since W is irreducible and symmetric, it is true that aw(g)yi(A) = ayi(A) for A G A[/(W (E) A). ■ 
Remark 3.4: The following are two extreme cases of A2 = A^ and A2 = 0. 

I. If the communication graph is complete, i.e. A2 = X„i, then for any p{A), we can select a such that W (g) A 

has eigenvalue. A, either in Au{A) with the algebraic multiplicity equal to a^(A) or inside the unit circle, 
n. If the communication graph is not connected then A2 = and the inequality condition stated in Proposition 



3.3 is not valid unless p{A) < 1. Also by the property of the Kronecker product, the algebraic multiplicity 



of X e Au{W ^ A) (nA[/(A)) is larger than aA{X). 
Remark 3.5 (Relation with a Consensus Problem): Consider the following consensus problem. 

x{k + 1) = Wa;(fc) = (/,„ - aL)x{k) (8) 

Notice that consensus is achieved if A2 7^ [15], i.e. 

lim x{k) = 1 • (1/to • l^a;(0)) 

We can see that the condition that A2 ^ is equivalent to p{A) < j^^^ with p{A) — 1. 



Remark 3.6: The choice of a in W = — aL affects the convergence rate of the error dynamics (|6]). Using 
the main theorem, under a proper choice of the gain parameters H, S, Q, and R, we may show that for every 
6 > 0, there exist c > and X < r < X + S such that 



< c-r" 



for all fc e N, where A = maxx^,zsp(L)\{i}\{^ — o^Xl) ■ p{A)\. 



Using Proposition 3.3 we state the following proposition. 
Proposition 3.7: If a pair {A, C) is detectable and it holds that 

Xm + X2 



piA)< 

Then (W ® A, C) with W = - aL is detectable for 



Xn 



X2 



a e (1 - p-\A)) , (1 + p-\A))) 
Before proving the above proposition, we give a lemma that describes the structure of eigenvectors of W®^ which 
correspond to eigenvalues in Ajj (W (g) A) in terms of eigenvectors of W and A. In general, an eigenvector of the 
Kronecker product of two matrices may not be the Kronecker product of two eigenvectors of the individual matrices. 



However, the following lemma shows that under our choice of a described in Proposition 3.7 an eigenvector of 
W (X) v4 corresponding to an eigenvalue in Au (W (g) A) can be written as the Kronecker product of eigenvectors 
of W and A. 

Lemma 3.8: Suppose the following inequality holds: 

Am + A2 



p{A)< 



Am — A2 



Then, under the choice of 



a^{X^'{\-p-\A)),X-J {\ + p-\A))) 
for A £ Ac/(W (g) A), a corresponding eigenvector, 1;, can be written as 

V = WW VA 

where ww e Null{W - I) and va e Null{A - XI). 

Proof: Let Aw and A^ be eigenvalues of W and A, respectively. Then by our choice of W = /,„ — aL with 



a e (X^^ (1 - p^^{A)) , A;;^^ (l + p^^{A))) and Proposition 3.3 A e A(7(W ® A) can be written as A = AwA^ 
only if Aw = 1 and A^ = A. Since the algebraic multiplicity of Aw = 1 is one, it holds that aw(giA(A) ~ aA{X). 
We can write the set of all generalized eigenvectors of A corresponding to A^i = A as 

fa,(^-A^/„)ei,-- - ,(A-A^/„r«i)6,... ,^3,(A,), 

^ , (9) 

(A - A^/„)^,,(,,), • • • , (A - Aa/„)"^«-'^-'^^s.(a.)} 



,m(^i)} and i G {1, 



(10) 

5a(Aa)}, where 



(11) 



where m{£^i) is the largest integer such that {A — \Aln)"^^^^^ii is nonzero (see [18] for details). We can see that 
the cardinality of the above set is equal to aA{\A), and 

[{A - A^/„)"(«^)6, ■■■ AA- Aa/„)"««-'^-')Cs.(a.)} 

becomes the set of all eigenvectors of A corresponding to A^. 
We claim that for A — \a, 

im®{,A- \Alnfii 

is a generalized eigenvector of W®^ corresponding to A for / e {0, 
vw E NullCW — I). To prove this claim, consider the following. 

For 0<l < m(6), 

{W(E)A- XAlrn-n) (I'W <E) {A ^ Aa/™)'^.) 
= i;w ® A{A - XAln)'Ct - WW «) Xa{A - XaIuYC 

= i;w® (A-A^/j'+'e. ^0 
The first equality comes from the fact that W • uw = ww- For / = m{^i), ( [TO] i becomes an eigenvector of W ® A 
since {A - A^/„)"(«'^+i6 - 0. 

Note that let t;i , U2 G I^™ and wi,W2 € M" be nonzero vectors, then vi ® Wi and V2 ® W2 are linearly independent 
if and only if either vi and V2 or wi and W2 are linearly independent. Hence 

{ww (Xi (A - AA/«)'Ci}/e{o,- ,m(5.)}, je{i,- ,sa(Aa)} 
is the set of all generalized eigenvectors of W ® A corresponding to A — A^. In particular, 

becomes the set of all eigenvectors ofW^A corresponding to A = A^. This proves our claim. ■ 
Proof: [The proof of Proposition |3.7) To show that (W ® A, C) is detectable, we only need to show that 
for an unstable eigenvalue of W ® A, its corresponding eigenvector, v, satisfies Cv ^ 0. By Lemma 3.8 for 



A e A[/(W (g) A), its corresponding eigenvector, v, is of the form v = uw ^ va, where ww G iVuZZ(W — /) and 
VA e Null{A — XI). Since W is a stochastic matrix, the eigenvector of W corresponding to Aw = 1 is l/^/m-l. 
Thus, we obtain 



Cv = l/V™ • C(l (g) wa) = l/\/m • 



( C^va\ 
C2VA 



(12) 



Since {A, C) is detectable, Cv is nonzero. This proves the statement that the pair (W (g A, C) is detectable. ■ 
In a view of output feedback, if (W (E) A, C) is not detectable, it is not possible to find the gain parameters H, 
S, Q, and R which stabilize (|6]l. In this context, if {A, C) is not detectable then (W ®A, C) is also not detectable; 
hence there exist no gain parameters that stabilize (|6|. 



Example 3.9: This example shows the reason why we need a connected communication graph, even if {A, C) 
is detectable. Suppose the system matrices A, C and the weight matrix W are given as follows. 

A = h, Ci = [1 0], C2 = [0 1 0], C3 = [0 1], 

"^1 - a a o\ 
W = l3-aL= a l-a 

We can see that {A, C) is observable (thus detectable). However, for the eigenvector v — {0 1)^ ® (1 1 0)^ of 
W^A corresponding to an eigenvalue at 1, it holds that Cv = 0. Hence the system (W^A,C) is not detectable. 



(13) 



B. Gain Parameters: H, Q, R, and S 

Here we study the choice of the gain parameters of the augmented observer Q subject to W = /,„ — aL. 
This is done by writing our formulation into a form that allows us to apply results from decentralized control 
Uterature [13], [14]. To apply the results from decentralized control literature, we need to verify, in a view of output 
feedback, whether unstable modes (eigenvalues) in our formulation can be stabilizable An algebraic way to check 
this condition is presented in Theorem 1 of [14]. Using this condition, we explicitly state and prove a sufficient 
condition under which each unstable mode of the error dynamics is stabilizable. This draws a direct relation between 
the detectability of {A, C) and the existence of the gain parameters for the observers under a sparsity constraint. 

The following notation is additionally defined for convenience. 

• Given {Vi}ig{i ... „}, diag ({V^i}ie{i ••• m}) is a block diagonal matrix. 



. Given {Vi^j}j(z{i^...^rn} and TV = {ji,-" ,3s} C {1, • • • ,m}, we define Vi^^^ 
First, observe that W (E) A — iiC can be written as 



def 



and £V = 



(14) 



- def 

where Bi = E^. ® In, H., 
imposed on for each i. 
Letting 



def 



Hi, AT, I , and C, 



def 



Ci. Notice that unlike H, there is no sparsity constraint 



-B = (Si, • • • , i?m) , C = (Cf , • • • , C^) 
H = diag ({Hi}ig{i,... , S = diag ({SJigii, 



.}) 



^We want to make a note that the notion of these unstable modes of our network of observers, which is subject to a sparsity constraint, is 
slightly different from that of the (standard) Luenberger observer due to the sparsity constraint. For more detail, we refer readers to [19], [20], 
[21] 



with Hi ''^= Hi TVi^ and Si "'^ ^i.j\fii, we can rewrite (|6]l as follows. 

't{k + l)\ fw(g)A-BB.C -BS\ fe{k) 
^z{k + l)) \ QC K ) \z{k)^ 

To prove the main theorem, we first find the Kalman decomposition for both {A, Ci) and (W ® A, Bi, Ci), and 
explicitly show that the observable part of {A,Ci) is actually contained in the controllable and observable part of 
(W ^ A, Bi,Ci). In the preceding propositions, we have seen that Aij{A) — Ac/(W (X) A) with the same algebraic 
multiplicity, i.e. ayi(A) = aw®yi(A) for A S Aii{A). Hence if {A,C) is detectable then every unstable mode of 
W(g) A is contained in the controllable and observable part of (W® A, Bi, Ci) for some i E {!, - ■ ■ , m}. Applying 
the result in [13], [22], we verify that every unstable mode of W (g) A can be placed inside the unit circle by a 
proper choice of the gain parameters H, Q, R, and S. This proves the existence of the observers. 

The following lemmas provide a basis for proving our main theorem. 

Lemma 3.10: Suppose the pair {A, C) is detectable and 

Am + A2 



def 



(15) 



p{A)< 



Am ^ A2 



holds. Then, under the choice of 



ae (A2-i(l-p-i(^)),A-i(l + p-\^))), 

taking the multiplicity into account, it is true that every unstable mode of W(g)yl is in the controllable and observable 
part of (W (X) A, Bi, Ci) for some i e {1, • • • , m}. 

Proof: The proof is given in Appendix | V-A| ■ 
Lemma 3.11: Given A G M"^", {.Bi},g|^ ... and {Ci}^^^^,,, consider a paitition, {ii,--- ,«;} and 
{k+i, • • ■ , «m}, of the set {1, • • • , m). For A G sp{A), let k^ = dim (^Null (^A - \I B,, ■■■ Si,) 
Suppose there exist /cg lineai^ly independent eigenvectors, {f?j}je{i, - ,fce}' °f corresponding to A such that 



1j 



Null 



(c \ 



Then it holds that 



rank 



where n is the dimension of the matrix A. 



(a-\i B, 

C 







> n 



Proof: The proof is given in Appendix V-B 



Proof: [The proof of Theorem 3.1 1 In this proof, using Lemma 3.10 and 3.11 we show the existence of the 
gain parameters which stabilize the error dynamics ([6|. 



Let {ii, - ■ ■ , ii} and {ii+i, ■ ■ ■ , im} be a partition of the set {1, • • • , m}. Then by Lemma 3.10 for the (left) 
eigenvector 5 of W (g) A corresponding to A e A[/(W (g) A), if q'^ (^Bi^ ■ ■ ■ Bi, 



— then there exists an 



associated (right) eigenvector, p, such that p ^ Null 



; otherwise there exists A e Au ( W (g A) that is not 



contained in the controllable and observable part of (W (g A, Bi, Ci) for any i £ {!, - ■ ■ , m}. 

Notice that this holds for any partition {zi, • • • ,ii} and {ii+i, ■ ■ ■ ,im}, and for any such partition, by Lemma 
|3.11| it is true that 



fW(g)A~XI Bi 



rank 



a. 







Br, 





> n ■ m 



\ c^^ ••• 0; 

By the result in [13], [22], there exist H, S, Q, and R that stabilize the error dynamics ( fTsj ) and satisfies 

■P(H) < V[L),V{S) < V{L),V{Q) < V{L),V{Il} < V{L) 
This proves the existence of the gain parameters for the augmented observers. 



Remark 3.12: In Theorem 



3.1 



we have seen that if the inequality condition p{A) < 



A„+A2 



holds then the 



existence of the gain parameters follows. However as the proof of our main theorem suggests it is possible to find 
more general condition for the existence of a network of observers for this distributed estimation problem. 

Remark 3.13: We want to mention that even if the result in [13], [22] gives H, S, Q, R which satisfy the sparsity 
consb-aint, for Q and R, it only holds that V{Q) < V{Im) < V{L) and 7'(R) < V{I„i) < V{L), i.e. Q and R 
are block-diagonal. 



IV. Discussions and Future Work 

In this paper, we study the structure of a network of observers of the form ^ for estimating the state of a LTI 
system described in ([T]). The existence condition for such observers is characterized by the spectral radius of A 
and the eigenvalues of the Laplacian matrix of the underlying communication graph. In particular, we show that if 
it holds that p{A) < ^"^^^ then the state estimate of each observer asymptotically converges to the state of the 
LTI system. In other words, let Xi{k) and x{k) be the state estimate by observer i and the state of the LTI system, 
respectively. If the existence condition is satisfied then ||ii(fc) — a;(fc)|| as fc — > 00 for alH e {1, • • • ,m}. 

However, some parts of the conditions, given and proven in this paper, may not be strict and the choice of 
parameters is not optimal. For example, when choosing the weight matrix W, instead of finding W that minimizes 
its spectral radius while satisfying a sparsity constraint, we adopt W = / — aL. This choice of W can be improved 



by solving an optimization problem [15]. Also as mentioned in Remark 3.13 when applying the result of [13] 



[14], the possible choice of the gain parameters is not fully utilized, especially Q and R. 



As future works, it may be interesting to find the parameters, which minimizes the relative effect of the noise 
on the estimation error. This problem is nontrivial because the sparsity constraint makes the minimization problem 
non-convex. 

In addition, as our approach relies on a centralized computation of the parameters, designing an algorithm for 
distributed computation of the parameters must be an intriguing problem. This may allow individual observers to 
reconfigure their parameters under a switching cormnunication graph. 

V. Appendix 



A. Proof of Lemma 3.10 



Lemma 5.1: Suppose the (symmetric) weight matrix W has eigenvalues inside the unit circle except at 1 with 
the algebraic multipHcity one. Let W, (e^, We,, • • • , W^-^e,f . Then Null{Wi) C Null{l^). 

Proof: By the definition of the null space and the Cayley-Hamilton theorem, NullCWi) = njLj^Null (ef W-'^^) = 
r\f^^Null (efW^-i). 

Note that W is symmetric and l/^/rn- 1 is a unique (unit) eigenvector, corresponding to Aw = 1- Also Aw = 1 
is the only unstable mode of W. Thus W-' converges to 1/m • 1 • 1^ as j — ^ oo. From this fact, we can see that 
[r\f^^Null (efW^'^i)]^ D \Jf^^Range{MV^-^ei) D Range{l). 

Since M™ is a finite dimensional vector space, it is true that Null{W^) = r\°^-^Null (ef WJ^^) C [uf^^Range (W-J'^^ei)] ^ C 
[Range{l)]^ ^ Null (l^). This proves our claim. ■ 

Proof [Proof of Lemma |3.10| Under the choice of W = I„^-aL with a e (A^^ (l - p^^A)) , A^^ (l + p-^{A))), 



it is true that only unstable modes of W <E) A are that of A, where the relation between their corresponding 



eigenvectors is explicitly shown in Lemma 3.8 By the property of the Kronecker product and Lemma |3.8[ it is 
straightforward to see that the number of unstable modes of W^A coincides with that of A, i.e. gwi^A{^) — 
for A e Au{W®A). 

In this proof, we show that, by applying the Kalman decomposition method, the observable part of {A, Ci) is 
contained in the controllable and observable part of {W ® A,Bi,Ci). Then, since {A,C) is detectable, this proves 
our claim. 

For notational convenience, we define the following notation. 

. Given {aj,g{i_...^„} and {ji, ••• C {1, n}, we define ai^^^... = {a^^, • • • , aj,}. 
Let fcj = dim {Null (Oi)), where Oi is the observability matrix of {A,Ci). Then we can construct a n x n 
nonsingular matrix P as follows. 

P = - ,k,},P{k,+l,--- ,n}) 

where ^{1,...,^^} Q Null{Oi) and P{ki+i.--- ,n} ^ Range{Of). Note that we may choose column vectors in P to 
be orthogonal to each other. 



Then by the Kalman decomposition, we obtain 



A'- > A 



A 



c.p = c. 



where (^g\c«) 



6i , "We^ , 



{li + l,--- ,m~ 



is an observable part. 

Similarly, let Oi be the observabihty matrix of (W^A, Bi,Ci) and li = dim (^Null (( 
Choose (/3{i^... J, ,„}), where ^{i,... C iVw^Z ((e„ We,, • • • , W"-ie,)^) 

Range(ei,'Wei, ■ ■ ■ , W™~^ei), and /3,„ = 1/y^-i|^ By Lemma 5.1 and the structure of (e^, We^, • 
we may choose ^/;}, ,„i}) to be nonsingular, and /?,„ to be orthogonal to f3j for j E {1 

Then we can construct a matrix Pw as 



(16) 



0^ 



1} c Nuii{i^)r\ 

■ ,W"-ie,)^ 
••• ,m-l}. 



P. 



w 



-1} 



'Pi 



V{l,-,t},l3m » ^'l,C{l,-:S}'/3m ® P2} 

where Pi and P2 = pj^.+i ...„}. Here T^ji ... andi^j^ ...^j are chosen properly so that span ... /.jC 

P,/3{/.+i ... .m-i} ® Pi,?7{i.... ,t}:Pm Pi} — Null{Oi) and Pw is nonsingular. In particular, by our choice of 
,m} and P, each ?;j can be written as a linear combination of column vectors in ,m} ^ P2 for 

j e {1, • • • , t}. Similarly each can be written as a hnear combination of column vectors in ... ,m-i} <8) P2 

for je {I,... 

Using Pw, we can describe the observable part of (W ^ A, Bi,Ci) as follows. 



i^^' =Pw'(W®A)Pw = 



A 



(0 



(17) 



C-f') = (e 



a)p 



w 



C, 



where (v4[;\c^') 



Let A^ = 




is an observable pair. 



and = 



A 



0,1 



^0,2 



. Then we obtain from ([TTjl, 

P2) = /3„ ® AP2 



w 



'2,4 

(«) 
0,2 

(i) 



(/?{!,.. ,i,}®P,% 



-1} ®^'i,»y{i,..,t})4!2 



'^2)4!4 



From Lemma js.lj we can infer that /3m = 1/ \/m • 1 £ Range ( , We^ , ■ ■ ■ , W" ^ ) 

Since we already have /3m P2 in Pw ^nd span (/3m ^2) H A'^uZi (Oi) = 0, is represented by columns in , 



Hi + l,--- ,m-l 



The first equality comes from the fact that W/3m = /3m- Since A'^*^ is uniquely determined by W A and Pw, 
we obtain A^^% = A^^.^ = and A^i\ = J^^\ A^^^^ = A^j', where A^'' and A^^^ ai-e defined in ([T6|. In addition 
we see that c'^q — ^(ef Ci)^{i^... , (l/\/m)CQ^y Hence the observable part of (A, C) is contained in the 
observable part of (W ® A,Bi,Ci). 

To show that modes of J^q in A^'^ are controllable in (W ® A,Bi,Ci), first notice that (g) q)'^Pw — 
(O, • • • ,0, (/3„ (g) q)^ri^i ... , q^Pi, 0, • • • ,0, P-i) where g is an (left) eigenvector of A. From our construction 
of q, Pi, P2, we know that [q^ Pi, q^ P2) is a left eigenvector of A^'^\ Thus every left eigenvector of A'q in A^^^ 
is identified with /3m ® q for some eigenvector q of yl. It is straightforward to see that (/3„i (g) qf" Bi is nonzero for 
all i G {1, • • • , m} and eigenvector g. Therefore, every mode of a'^q in A^"^^ is controllable, and we conclude that 
the observable part of {A, Ci) is contained in the controllable and observable part of (W A, Bi,Ci). ■ 



B. Proof of Lemma \3.11\ 



3.11 



Proof: [Proof of Lemma 

dim {nuU {a - XI B, 



Let TiB be the number of columns in yBi-^ ■ ■ ■ Sj, j- Note that 

•• Bi,)^ = n + ns - rank (^A - XI B,, ■■■ Bi^ 

= n + riB ~ {n ~ k^) ^ k^ + njs 

I / 77j 

Let 0„g be a ng -dimensional zero vector. Since there exist fcg linearly independent vectors 




such that I '■' \^ Null [A -XI B,, ■■■ J but 



that 



dim 



Therefore, we obtain 

(a-xi B, 



Null 



(A-XI Bi, 



c n 



V 



(c \ 

B,\\ 



rjj is nonzero for all j G {1, • • • , fcg}, it holds 







\ 



= n + njs — dim 



0/ 



(a- XI Bi 



Null 



V V 



B.\\ 



0/ 



> 71 
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